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Abstract 

In conic linear programming - in contrast to linear programming - the Lagrange dual is not 
an exact dual: it may not attain its optimal value, or there may be a positive duality gap. The 
corresponding Farkas’ lemma is also not exact (it does not always prove infeasibility). We describe 
exact duals, and exact certihcates of infeasibility and weak infeasibility for conic LPs which are 
nearly as simple as the Lagrange dual, but do not rely on any constraint qualification. Some of 
our exact duals generalize the SDP duals of Ramana, Klep and Schweighofer to the context of 
general conic LPs. Some of our infeasibility certificates generalize the row echelon form of a linear 
system of equations: they consist of a small, trivially infeasible subsystem obtained by elementary 
row operations. We prove analogous results for weakly infeasible systems. 

We obtain some fundamental geometric corollaries: an exact characterization of when the linear 
image of a closed convex cone is closed, and an exact characterization of nice cones. 

Our infeasibility certificates provide algorithms to generate all infeasible conic LPs over several 
important classes of cones; and all weakly infeasible SDPs in a natural class. Using these algorithms 
we generate a public domain library of infeasible and weakly infeasible SDPs. The status of our 
instances can be verified by inspection in exact arithmetic, but they turn out to be challenging for 
commercial and research codes. 

Key words: conic linear programming; semidefinite programming; facial reduction; exact duals; 
exact certificates of infeasibility and weak infeasibility; closedness of the linear image of a closed 
convex cone 
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1 Introduction and a sample of the main results 


Many problems in engineering, combinatorial optimization, and economics can be expressed as a conic 
linear program (LP) of the form 

sup (c, x) 
s.t. Ax <K b, 
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where A : M"* —y is a linear map, y is a finite dimensional Euclidean space, K C V is a closed 
convex cone, and s <k t stands for t — s G K. We naturally associate a dual program with 0: letting 
A* be the adjoint of A, and K* the dual cone of K, its Lagrange dual is 

inf (6, y) 

s.t. A*y = c (D) 

y >K- 0. 

Problems 0 and 0 generalize linear programs, and weak duality - the inequality (c, x) < {b, y) 
between a pair of feasible solutions - trivially holds. However, in contrast to linear programming, the 
optimal values of 0 and of © may differ, and/or may not be attained. 

A suitable conic linear system can prove the infeasibility of 0 and of 0: their classical alternative 
systems are 

A*y = 0 Ax >K 0 

(Halt) {b,y) = -1 and {c,x) = -1. (L>ait) 

y >K* 0 

When (Fait) is feasible, 0 is trivially infeasible, and we call it strongly infeasible. However - again in 
contrast to linear programming - (Fait) and 0 may both be infeasible, and in this case we call 0 
weakly infeasible. We define strong and weak infeasibility of 0 analogously. 

These pathological behaviors - nonattainment of the optimal values, positive duality gaps, and 
weak infeasibility - occur in semidefinite programs (SDPs) and second order conic programs, which 
are arguably the most useful classes of conic linear programs. Pathological conic LPs are often difficult, 
or impossible to solve. 

This paper focuses on exact duals and exact certificates of infeasibility and weak infeasibility of 0 
and of 0. An exact dual, or strong dual of 0 is a conic LP with an ”inf” objective, which i) satisfies 
weak duality, ii) has the same optimal value as 0 , and iii) attains this value, when it is finite. We 
define an exact dual of 0 analogously. 

An exact certificate of infeasibility of a conic LP is a finite set of vectors, from which a suitable 
polynomial time algorithm (a ’’verifier”) can deduce that the conic LP is indeed infeasible. The term 
’’exact” stresses that such a set of vectors must exist for every infeasible instance. We define exact 
certificates of other properties (say of weak infeasibility) of conic LPs analogously. The latter definitions 
are informal, but they will be enough to explain our ideas and results; we also give a formal definition 
in Appendix]^ For simplicity, we will often talk about the infeasibility of a conic linear system. 

Exact certificates of infeasibility of conic LPs, say, of 0 will appear in one of the following forms 
in this paper: 

• Either as a conic linear system which is feasible exactly when 0 is infeasible; 

• Or as a transformation of 0 into an equivalent problem, whose infeasibility is ’’easy” to verify. 

Exact duals and exact certificates of infeasibility of conic LPs are, of course, known in special cases. 
For example, if K is polyhedral, then 0 is an exact dual of 0> (Fait) is an exact certificate of 
infeasibility of 0> and (Fait) is an exact certificate of infeasibility of 0. If FT = {0}, then 0 is 
a linear system of equations; then both (Pait), the row echelon form of 0 (which contains an 
obviously infeasible equation (0,a:) = 1) are exact certificates of infeasibility. However, in general, 0 
is not an exact dual, and (Fait) and (Fait) are not exact certificates of infeasibility. Moreover, general 
conic LPs are not known to have an equivalent of a row echelon form. 
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This paper builds on three approaches, which provide exact duals, and exact certificates of infea¬ 
sibility for conic LPs (and which we review below, with other relevant references): the first is facial 
reduction algorithms - see Borwein and Wolkowicz [Hill], Waki and Muramatsu m, Pataki 113; 
and the second is extended duals for SDPs and generalizations - see Ramana [32], and Klep and 
Schweighofer m- For the connection of these approaches, see Ramana, Tungel and Wolkowicz [34] . 
and m- The third approach is that of elementary reformulations of SDPs, which is more recent - see 
HHj and pi] . 

The reason that {Pa.it) and (Dait) are not exact is that the linear image of a closed convex 
cone is not always closed. For studies on when this image is closed (or not), see Bauschke and Borwein 
ID; and Pataki |2S|. 

Here we unify, simplify, and extend the above approaches and develop a collection of exact duals, 
and certificates of infeasibility and weak infeasibility in conic LPs with the following features: 

(1) They do not rely on any constraint qualification (CQ), such as strict feasibility of 0 (which 
requires that there exist x G K™ such that b — Ax is in the relative interior of K). 

(2) They inherit most of the simplicity of the Lagrange dual (see Sections Hi and|^. Some of our 
infeasibility certificates generalize the row echelon form of a linear system of equations, as they 
consist of a small, trivially infeasible subsystem obtained by elementary row operations. The 
size of this subsystem is bounded by a geometric parameter of the cone, the length of the longest 
chain of nonempty faces. The results for weak infeasibility are analogous. 

(3) Our exact dual of 0 generalizes the exact SDP duals of Ramana [52| and Klep and Schweighofer 
m to the context of general conic linear programming: it is a conic LP whose constraints are 
copies of the original constraints. 

Our exact certificate of infeasibility of 0 refines the certificate given by Waki and Muramatsu 
in [40] by showing that it can be viewed as a conic linear system. 

(4) They yield some fundamental geometric results in convex analysis: bounds on the number of 
constraints that can be dropped or added in a conic linear system while keeping it (weakly) 
infeasible (Corollary in Section]^; an exact characterization of when the linear image of a 
closed convex cone is closed; and an exact characterization of an important class of cones, called 
nice cones (see Section]^. 

(5) They provide algorithms to generate all infeasible conic LP instances over several important 
cones (see Sections and|^, and all weakly infeasible SDPs in a natural class (Section]^. 

(6) The above algorithms are easy to implement, and they provide a challenging test set of infeasible 
and weakly infeasible SDPs: while we can verify the status of our instances by inspection in 
exact arithmetic, they are difficult for commercial and research codes (Section]^. 

(7) Of possible independent interest are an elementary facial reduction algorithm (Section]^ with 
a simplified proof of convergence and the geometry of the facial reduction cone, a convex cone 
that we introduce and use to encode facial reduction algorithms (see Lemma [^. 

We now describe our main tools, and some of our main results with full proofs of the “easy” 
directions. We will often reformulate a conic LP in a suitable form from which its status (as infeasibility) 
is easy to read off. This process is akin to bringing a matrix to row echelon form, and most of the 
operations we use indeed come from Gaussian elimination. To begin, we represent A and A* as 

771 

Ax = A*y = {{ai,y),{am,y))'^, where at GY for z = 1,..., to. 

i=l 
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Definition 1. We obtain an elementary reformulation or reformulation of (P)-{D) by a sequence of 
the operations: 

(1) Replace (a^, q) by (>1A, (c, A)) for some i G m}, where A S K™, A^ ^ 0. 

(2) Switch {oi^Ci) with {aj^Cj), where i 7 ^ J Q 

(3) Replace b by b + Ap., where p € K™. 

If K = K* we also allow the operation: 

(4) Replace Oi by Tai{i = 1,..., m) and b by Tb, where T is an invertible linear map with TK = K. 

We call operations (l)-(3) elementary row operations. Sometimes we reformulate only 0 or 
or only the underlying systems, ignoring the objective function. Clearly, a conic linear system is 
infeasible, strongly infeasible, etc., exactly when its elementary reformulations are. 

Facial reduction cones “encode” a facial reduction algorithm, in a sense that we make precise later, 
and will replace the usual dual cone to make our duals, and infeasibility certificates exact. 

Definition 2. Let k > 0 be an integer. The order k facial reduction cone of K is the set 

FRk{K) = { (yi,.. .,yk)-yiG K*, y,G{Knyin.. .ny^_^)\i = 2,...k}. 

We drop the subscript k when its value is clear from the context or if it is irrelevant. 


We have FRo(itr) = 0, FRi(i4r) = K* and we can pad elements of FRfe(Rr) with zeros to make 
them elements of a higher order facial reduction cone, hence these sets serve as relaxations of K*. 
Surprisingly, FRfe(Rr) is convex, which is closed only in trivial cases, but behaves as well as K* under 
the usual operations on convex sets - see Lemma 

We now state an excerpt of our main results with full proofs of the ’’easy” directions: 

Theorem I If RT is a general closed convex cone, then 


( 1 ) ^ is infeasible if and only if it has a reformulation 


K,y) 

K+i^y) 

{a'i,y) 

y 


= 0(i=l,...,fc) 

= -1 

= c' (i = fc + 2 ,..., m) 

>^. 0 


(Dref) 


where k >0, {a [,..., S FR(Rr*). 

( 2 ) © is not strongly infeasible if and only if there is £ > 0 and (yi,..., y^+i) G FR(Rr), such that 


A*y, = 0{i = 

A*yi+i = c. 

^Performing a sequence of operations of type Q and is the same as replacing A by AM and c by M'^c, where M 
is an m X m invertible matrix. 
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□ 


Part (1) of Theorem I generalizes the row echelon form of a linear system of equations: it finds a 
small, trivially infeasible subsystem in © using only elementary row operations. As we prove later, 
the size of the subsystem (i.e., fc + 1) is bounded by a geometric parameter of K *. Also, if AT* is the 
whole space, then FRfc+i(A'*) = {0}^+^, so the constraint (0,y) = —1 in (I^ref I proves infeasibility. 
Turning now to part (2), we note that if £ = 0 then © is actually feasible. 

Naturally, combining the two parts of Theorem I we obtain an exact characterization of weak 
infeasibility. We prove the ’’easy”, i.e., the ”if” directions below: 


Proof of ”if” in part (1) We will prove that (Z?ref I is infeasible, so suppose that y is feasible in it 
to obtain the contradiction 


y G K* n a'l n ... n 


{a'k+i,y) > 0 . 


Proof of ”if” in part (2) Let us fix (yi,. .., yn+i) as stated, and x such that Ax >k 0. Then 

{c,x) = {A*yi+i,x) = {yi+i,Ax) > 0, 

where in the inequality we used Ax G K H y^ H H yj-. Thus (Dait) cannot be feasible. □ 

We illustrate Theorem I with a semidefinite system, with Y = the set of order n symmetric 
matrices and K = K* = 5" as the set of order n symmetric positive semidefinite (psd) matrices. The 
inner product oi a,b G 5" is a • 6 := (a, b) := trace(a6) and we write ^ in place of <k ■ Note that we 
denote the elements of by small letters, and we reserve capital letters for operators. 

Example 1. The semidefinite system 


( 1 . 1 ) 



2/^0 

is infeasible for any a > 0, and weakly infeasible exactly when 0 = 0. 


Since the constraint matrices in (1.1) are in FR(iS^), this system is in the form of (Href) (and itself 
is a proof of infeasibility). 


Suppose a = 0 and let 


2/1 = 


'0 O' 

,0 R 


2/2 = 


.- 1/2 


- 1 / 2 ' 

0 , 


( 1 . 2 ) 


Then ( 2 /i, 2 / 2 ) G FR(5^), A*yi = (0,0)^, A*y 2 = (0, —1)"^, hence ( 2 /i, 2 / 2 ) proves that (1.1) is not 
strongly infeasible. 

For a set S we denote by front(S') its frontier, i.e., the difference between its closure, and itself: 

front)^) :=clS'\5'. (1.3) 

Classically, the set of right hand sides that make © weakly infeasible is the frontier of A*K*; in the 
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a = 0 case 


For all such right hand sides a 


bont{A*K*) = {(0,A)^: (1.4) 

suitable (j/i,?/ 2 ) G FR(iS^) proves that 0 is not strongly infeasible. 


we 

we 


We organize the rest of the paper as follows. In the rest of the introduction we review prior work, 
collect notation, and record basic properties of the facial reduction cone FRk{K). In Section 2 
present our simple facial reduction algorithm, and our exact duals of 0 and In Section ^ 
present our exact certificates of infeasibility and weak infeasibility of general conic LPs. In Section^we 
describe specializations to SDPs. Sectionj^presents our geometric corollaries: an exact characterization 
of when the linear image of a closed convex cone is closed, and an exact characterization of nice cones. 
In Section we give our algorithm to generate all infeasible SDPs, define a natural class of weakly 
infeasible SDPs, and provide a simple algorithm to generate all instances in this class. In Sectionj^we 
present a library of infeasible, and weakly infeasible SDPs, and our computational results. In Section 
[^we discuss possible extensions of our work, and conclude the paper. 


The main ideas of the paper can be quickly absorbed by reading only Sections Hi and 1^ A 
reader interested in the geometrical/convex analysis aspects will probably want to read Section i 
other readers can skip this section at first reading. Section gives more insight into the structure 
of weakly infeasible SDPs, and Section is more for an audience interested in computation. The 
paper relies only on knowledge of elementary convex analysis and the results are illustrated by many 
examples. 


Prior work Facial reduction algorithms turn © into an exact dual of ( |P|) b y constructing a suitable 
smaller cone F, replacing AT by F in ©> and K* by F* (a larger cone) in (|D[). The first such algorithm 
was proposed by Borwein and Wolkowicz mm for nonlinear conic systems. Their algorithm assumes 
that the system is feasible. Waki and Muramatsu m described a variant for conic linear systems, 
which is simpler, and it is the first variant of facial reduction, which allows one to prove infeasibility. 
Pataki m proposed another simplified version, which is fairly straightforward to implement. 


We can construct exact duals of SDPs without relying on any constraint qualification, at the cost 
of introducing polynomially many extra variables and constraints - see Ramana |32j . and Klep and 
Schweighofer m- We note that Ramana’s dual relies on convex analysis, while Klep and Schweighofer’s 
dual uses ideas from algebraic geometry, namely sums of squares representations. While at first they 
seem different, the approaches of facial reduction and extended duals are related - see Ramana, Tungel 
and Wolkowicz [34] , and for proofs of the correctness of Ramana’s dual relying on facial reduction 
algorithms. The paper m generalizes Ramana’s dual to the context of conic LPs over nice cones, 
while Polik and Terlaky [30] extend Ramana’s dual to conic LPs over homogeneous cones. Ramana 
and Freund in [33] studied the Lagrange dual of the extended dual of Ramana in [33] , and proved that 
it has the same optimal value as the original problem. 


For recent studies on the closedness of the linear image of a closed convex cone we refer to Bauschke 
and Borwein [3]; and Pataki [25]. The paper [3] gives a necessary and sufficient condition for the 
continuous image of a closed convex cone to be closed, in terms of the strong conical hull intersection 
property. Pataki |25j gives necessary conditions, which subsume well known sufficient conditions, and 
are necessary and sufficient for a broad class of cones, called nice cones. See also [35[ Lemma I]) for 
a simplified exposition. We refer to Bertsekas and Tseng [^ for a study of a more general problem, 
whether the intersection of a nested sequence of closed sets is nonempty. The paper [3S] applies the 


^To outline a proof of (]l.4||, assume for simplicity A = 2. Then 

y := 1 ^ G 0 for all e > 0, 


and A*y = (e, 2)^ , so (0,2)^ S cl(yl*5^); the rest of (1.41 is straightforward to verify. 
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closedness result of |25j to characterize when a conic linear system is badly behaved; by bad behavior of 
Ax <K b we mean that there is a duality gap between © and © , or © does not attain its optimal 
value for some c. 

Borwein and Moors [iiin] recently showed that the set of linear maps under which the image is 
not closed is u-porous, i.e., it has Lebesgue measure zero, and is also small in terms of category. For 
characterizations of nice cones, see Pataki [26]; and Roshchina [38] for a proof that not all facially 
exposed cones are nice. 

Elementary reformulations of SDPs - see Pataki |55| and Liu and Pataki m - use simple operations, 
as elementary row operations, to bring a semidefinite system into a form from which its status (as 
infeasibility) is trivial to read off. Definition generalizes elementary reformulations of SDPs to the 
context of general conic LPs. 

Another related paper is by Lourenco et al |23j which presents an error bound based reduction 
procedure to simplify weakly infeasible SDPs, and a proof that all such SDPs with order n constraint 
matrices contain a weakly infeasible subsystem with dimension at most n — 1. Part (4) of our Theorem 
[^generalizes this result to the context of general conic LPs. 

For an application of facial reduction to the euclidean distance matrix completion problem see 
Krislock and Wolkowicz [ 20 ]; and Drusviyatsky et al m for a theoretical analysis of the algorithm 
in [ 20 ] • We refer to Waki in [ 30 ] for a method to generate weakly infeasible SDPs from Lasserre’s 
relaxation of polynomial optimization problems. 

For textbook treatments of the duality theory of conic LPs we refer to Bonnans and Shapiro [7]; 
Renegar [36]; Giiler [16]; and Borwein and Lewis [ 8 ]. 

A remark on notation: we consider the primal problem to be in inequality form, since this is how 
Ramana [ 32 ], and Klep and Schweighofer m presented their dual, and infeasibility certificate. The 
equality constrained dual form will be more useful to derive our geometric corollaries (in Section 
and to generate instances (in Section]^. 

Notation and preliminaries We assume throughout that the operator A is surjective. For an 
operator M we denote by TZ{M) its rangespace, and by N{M) its nullspace. For x and y in the same 
Euclidean space we sometimes write x*y for {x,y). For a convex set C we denote its linear span, the 
orthogonal complement of its linear span, its closure, and relative interior by linC, C'^, clC, and riC, 
respectively. We define the dual cone of K as 

K* = {y\{y,x) >0,\/x G K }, 


and for convenience we set 

K*\-i- ■- K*\K-^. 


We say that ([^ is strictly feasible, if there is y e liK* feasible in it. If (|^ is strictly feasible, then 
© is an exact dual of © (i.e., it has the same value, as ©, and attains this value, when it is finite). 

For F, a convex subset of K we say that F is a face of K, if y,z G K, and l/2(y + z) G F implies 
y,zGF. 

We denote by £k the length of the longest chain of nonempty faces in K, i.e., 

£k = max{ k\ Fi C F 2 C ■ ■ ■ C Fk are nonempty faces of K }. (1-5) 

For instance, £ 5 ^ = = n + 1. 
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If H is an affine subspace with HDK ^0, then we call the smallest face of K that contains HDK 
the minimal cone of H D K, i.e., it is 


P|{ G\G H D K, Gisafaceof K}. 


( 1 . 6 ) 


We call z € K a. slack in ( [p| ) , if z = b — Ax for some x € K™; if © is an SDP, then we call such a 
z a slack matrix. 

For a nonnegative integer r we denote by S'f, 0 {0} the subset of 5” (where n will be clear from the 
context) with psd upper left r x r block, and the rest zero. All faces of 5" are of the form 0 0)t 

where t is an invertible matrix mull- We write 

Aut(Ar) = { T : yy I Tis linear and invertible, r( AT) = AT} (1-7) 

for the automorphism group of a closed convex cone K. For example, T S Aut(iS") if and only if there 
is an invertible matrix t such that T{x) = t^xt for x € 5". 

In Lemma we record relevant properties of FRfc(Ar). Its proof is given in Appendix [B| 

Lemma 1. For k > 1 the following hold: 


(1) FRfe(Ar) is a convex cone. 

(2) FRfc(Ar) closed if and only if K is a subspace or k = 1. 

(3) //T e Aut(Ar), and (yi,... ,yfe) G FRfc(A:) then 

(T*yi,...,r*yfe) GFRfe(i^). 

( 1 . 8 ) 

(1.9) 

( 1 . 10 ) 


(4) If C is another closed convex cone, then 

FRkiK X G) = FRfc(iF) x FRfc(G). 

Precisely, 


if and only if 


{{yi,zi),...,{yk,Zk)) GFRkiKxG) 

(yi, ...,yk) G FRfc(A:) and (zi,. ..,Zk) G FRfc(G). 


Note that equation (1.8) somewhat abuses notation; the statement 
Also note that with k = 1 statement @ 


1.9[ ) (1.10) is fully rigorous, 

recovers the well known fact: T G Aut(Ar) ^ q 


2 Facial reduction and exact duals in conic linear program¬ 
ming 


In this section we present a very simple facial reduction algorithm to find F, the minimal cone of the 
system 

HnK, (2.11) 


where H is an affine subspace with HfiK 7 ^ 0, and our exact duals of © and of ©• The convergence 
proof of Algorithm with an upper bound on the number of necessary steps, is entirely elementary, 
and it simplifies the proofs given in [40] and m- Recall the definition of the minimal cone from (|1.6[).) 





We first illustrate the importance of the minimal cone: if F is the minimal cone of (2.11) then 

iJ nrii^ ^ 0 


(otherwise H n K would be contained in a proper face of F). Assume next that F is the minimal cone 
of (7^(A) + b) n K, where A and b are as in 0 - Then replacing K hy F makes 0 strictly feasible, 
and keeps its feasible set the same. Hence if we also replace AT* by F* in ([^, then © becomes an 
exact dual of 0. 

As illustration, we consider the following example: 

Example 2. The optimal value of the SDP 


sup Xi 



(o 

1 

0^ 


(0 

0 


/ 

S.t. Xi 

1 

0 

0 


0 

1 

0 




0 

oj 



0 

oj 

\ 


( 2 . 12 ) 


is zero. Its usual SDP dual, in which we denote the dual matrix by y and its components by yij, is 
equivalent to 


inf 2/11 




^ 2/11 

1/2 


S.t. 

1/2 

2/22 

2/23 


V - 2 / 22/2 

2/23 

yss 


(2.13) 


which does not have a feasible solution with yn = 0 (in fact it has an unattained 


0 infimum). 


Since all slack matrices in (2.12) are contained in 5:J_ © {0} and there is a slack 
element is positive, the minimal cone of this system is F = 5)]_ © {0}. If in the dual 
by F*, then the new dual attains with 


matrix whose ( 1 , 1 ) 
program we replace 


y := 



1/2 


/© 

X 


1/2 

0 

o' 

e F* = X 

X 


V 0 

0 

oj 


X 

x/ 


(2.14) 


being an optimal solution. Here the © and x symbols stand for psd and arbitrary submatrices, 
respectively. 


To construct the minimal cone of F n AT we rely on the following classic theorem of the alternative 
(recall =K*\K^). 

HnriAr = 0 <^Ar^nA:*\-^ 7^0. (2.15) 

Algorithm repeatedly applies the equivalence (2.15) to find F : 


Algorithm 1 Facial Reduction 
Initialization: Let yo = 0, Fq = K, i = 1. 
while 3yi G iJ-*- n F*};f' do 
Choose such a yi. 

Let F, = F,_i n y:t- 
Let i = i + 1. 
end while 
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(2.16) 


Algorithm generates a sequence of faces 

F = Fk C Fk-i C ... Fq = K. 

The reason that F = Fk holds for some k, is that once we stop, riFkD H 7 ^ 0. Since 

ri Ffc n i/ = riFk r\ H n K = ri Fk Cl H Cl F, 

we deduce ri n A 7 ^ 0. Thus by Theorem 18.1 in m we obtain Fk F F with the reverse containment 
already given. 

To bound the number of steps that Algorithm needs, we need a definition; 

Definition 3. For k>l we say that (yi, ..., yk) S FRk{K) is strict, if 

Vi e {Kr\y^r\---nyjLi)*'^^ioii = 2,...,k. 

We say that it is pre-strict if (yi,, yk-i) is strict. 

Theorem 1. If (yi,... ,yk) is strict, then these vectors are linearly independent. Also, Algorithm^ 
stops after at most 

min {Ik — I, dim } 

iterations. 


Proof To prove the first statement, assume the contrary. Then for some 2 < i < k a contradiction 
follows: 

yi e lin{yi,...,y,_i} C {Kny^D ■ ■ ■ n y:t-i)'^ ■ 

The second statement is then immediate. □ 

Example 3. (Example continued) Algorithm 1 applied to this example may output the sequence 


yi = 


y2 = 



\0 0 

F 2 = F, 



(2.17) 


where again the 0 symbol corresponds to a psd submatrix. Note that yi € in this context means 
that 2/1 and 2/2 are orthogonal to all constraint matrices in the system ( 2 . 12 ). 


From Theorem we immediately obtain an extended exact dual for described below in ( |T>ext| )- 
Note that ( |Zlext| ) is a conic linear program whose data is the same as the data of © , thus it extends 
the exact SDP duals of Ramana [32] and Klep and Schweighofer [19] to the context of general conic 
LPs. The underlying cone in (Dext) is the facial reduction cone: thus, somewhat counterintuitively, 
we find an exact dual of © over a convex cone, which is not closed in all important cases (see Lemma 

Si- 

Theorem 2. For all large enough k the problem 


inf b*yk+i 

s.t. A*yk+i 

A*y^ 

b*y^ 

{yi,...,yk+i) 


= 0{i = l,...,k) 
= 0{i = l,...,k) 
e FRfe+i(K) 


(Dext) 
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is an exact dual of {P). 


When the value of © is finite, for a suitable k the problem (Dext] ) has a pre-strict optimal solution 
with the same value. 


Proof 

then 


We first prove weak duality. Suppose that x is feasible in (P) and (yi,. 

{b, yk+i) - (c, x) = {b, yk+i) - {A*yk+i,x) 

= {b- Ax,yk+i) >0, 


. .,yk+i) in (£>ext), 


where the last inequality follows from b — Ax G iiT n yj*- n • • • n . 

To prove the rest of the statements, first assume that 0 is unbounded. Then by weak duality 
(I?ext) is infeasible. Suppose next that 0 has a finite value v, and let F be the minimal cone of 0. 
Let us choose y £ F* to satisfy the affine constraints of © with b*y = V. We have that 

F = Kny^n---nyi 

for some fc > 0 and (yi,... ,yk) £ FRk(F) strict, with all y^ in (7Z(A) + 6 )-*-. Hence if we choose this 
particular k in (Dg^t I, then (yi,..., y^, y) is feasible in it with value v. (If we choose k larger, we can 
just pad the sequence of y^ with zeros.) This completes the proof. □ 

Example 4. (Examplecontinued) If we choose yi,y 2 as in (2.I7I and y as in (2.14|, then (yi,y 2 ,y) 
is an optimal solution to the extended dual of ( 2 . 12 ). 

Theorem 3. If is feasible then it has a strictly feasible reformulation 


inf 

b*y 


s.t. 

II 

0 (z = l,...,fc) 


II 

c' (z = fc + I,..., to) 


y G 

AT* n a'f^ n • • • n a',^ 


with fc > 0 , {a'l,... ,a'ff) £ FR(i4r*), which can be chosen strict. 


(Tlref ,feas) 


Proof Let us fix y such that A*y = c, and let G be the minimal cone of 

iy+MiA*))nK*, 

i.e., of the feasible set of ©■ Since Algorithm I can construct G, there is fc > 0 and a strict 
{a[,..., a'f.) £ FR(Ar*) such that 

a' G 7^(A) ny-^ (z = 1,... ,fc), 

G = K* 

By Theorem]^ the vectors a'l,..., a'f. are linearly independent, so we can expand them to 

A' = [ai,...,Ofe,a).+i,...,a(„], a basis of 77(A). 

Let us write A' = AM with M an invertible matrix. Replacing A by A' and c by M'^c yields the 
required reformulation, since M^c = M'^A*y = A'*y, so the hrst fc components of M'^c are zero. □ 


II 









Note that we slightly abuse terminology by calling (-Dref.feas) a reformulation of 0: to obtain 
(£*ref ,feas I we not Only reformulate 3ut also change the underlying cone. 


We now contrast Theoremj^with Theorem]^ In the former the minimal cone of (P) can be written 


as 


PT n n 




where (yi,..., j/fc+i) is some feasible solution in (Pextl- In the latter the minimal cone of the 
feasible set of © is displayed by simply performing elementary row operations on the constraints. 
Thus, letting G denote this minimal cone, it is easy to convince a “user” that the Lagrange dual of 


(Pref.feas), namely 


E m / 

i^k+l ^iCi 
EZLi Xia'i <G* b 


(2.18) 


is an exact dual: the proof of this fact is some y S riG, which is feasible in (Pref.feas I, and the 
constraint set of (Pref.feasj) which proves that all feasible solutions are in G. 


To illustrate Theorem]^ we continue Example 

Example 5. (Example continued) We can rewrite the feasible set of this example in an equality 
constrained form; note that if z is a feasible slack in (2.12), then the equations 


/O 0 
0 0 
\0 0 
0 0 


0 


0 
0 
1 

- 1 ' 

0 

0 


• z = 0 


= 0 


(2.19) 


must hold, and the constraint matrices in (2.19) form a sequence in FR(iS(^). (Of course z must satisfy 
two other linearly independent constraints as well, which we do not show for brevity.) 


To find the y^ in Algorithm one needs to solve a certain pair of reducing conic linear programs 
(over K and K*). This task may not be easier than solving the problems © and @, since the primal 
reducing conic LP is strictly feasible, but its dual is not (see e.g. [IZl Lemma 1]). We know of two 
approaches to overcome this difficulty. The first approach by Cheung et al m is using a modified 
subproblem whose dual is also strictly feasible. The second, by Fermenter and Parrilo in [22] is a 
“partial” facial reduction algorithm for SDPs, where they solve linear programming approximations of 
the SDP subproblems. 


3 Certificates of infeasibility and weak infeasibility in conic 
linear programming 


We now describe a collection of certificates of infeasibility and weak infeasibility of © and of © below 
in Theorem]^ which contains Theorem 1. In Theoremj^we state the results for the dual problem first, 
since we will mostly use these later on. We need to recall the definition of £k from (1.5). 


Theorem 4. When K is a general closed, convex cone, the following hold: 
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(1) 0 is infeasible, if and only if it has a reformulation 


{a'i,y) 

K+i:2/) = 

y >K- 


Q{i = l,...,k) 

-1 

c'(z = /c + 2,...,m) 

0 , 


(^ref) 


where (a^,..., a'f^j^f) € FR(i^*) and 0 < k < — 1- 

(2) 0 is not strongly infeasible, if and only if there is {yi,... ,ye+i) G FR(K), such that 0 < £ < 
£k — 1 and 


A*y^ = 0{i = !,...,£) 
A*yi+i = c. 


(3) (P) is infeasible, if and only if there is {yi ,..., yk+i) G FR(i(r) such that 0 < k < £k — £ and 

A*yi = 0, b*yi = 0 {i = l,...,k) 

A*yk+i = 0, b*yk+i = -1. 


(4) {P) is not strongly infeasible, if and only if it has a reformulation 

m 

'^Xia[<Kb', (Prel) 

i=l 

where (a^,..., a^, b') G FR(Rr*) and 0 < £ < min { to , £k» — 1 }• 


The facial reduction sequences can be chosen to be pre-strict in all parts. 


□ 

Parts Q through (|3 in Theorem should be read separately: the k integers in parts Q and 
the £ in parts ([^ and^^, etc. may be different. We use the current notation for brevity. Also note 
that since K is an arbitrary closed, convex cone, in the reformulations we only use elementary row 
operations (cf. Definition]^. 

For the reader’s sake we first discuss and illustrate Theorem]^ and prove a corollary, before proving 
Theorem |4] itself. 

We first look at the simplest cases, when A: = 0 or ^ = 0. We can choose fc = 0 in part (1) exactly 
if there is x such that Ax >k 0 and {c,x) = —1, i.e., if © is strongly infeasible. Similarly, we can 
choose € = 0 in part (2) iff there is yi G K* such that A*yi = c, i.e., if © is actually feasible. Similar 
statements hold for parts ([^ and Q, and we leave the details to the reader. 

We next examine the ’’easy”, i.e., the ”if” directions. The ”if” directions for parts Q and ([^ 
were proved after Theorem I. The ”if” direction for part ([^ can be proved similarly to the proof of 
weak duality in Theorem]^ Next we prove the ”if” direction in part Q. It suffices to show that the 
subsystem 

i 

'^Xiai<K b', (3.20) 

2=1 


13 


is not strongly infeasible, so suppose it is. Applying the alternative system (Pait) (defined in the 
Introduction) to (3.20), we find that the system 


= 0(i = !,...,£) 

{h',y) = -1 (3.21) 

y >K* 0 


is feasible. Since (a),..., a^, b') G FR(Ar*), we have 

h' G {K* n a'l-^ n • • • n 4 -^)*, 


thus for any feasible solution of (3.21) we must have (6', y) > 0, a contradiction. 

Note the similarity between parts (1) and (4). Part (1) provides a certificate of infeasibility of © 
in the form of a trivially infeasible subsystem. Part (4) gives an analogous certificate of “not strong 
infeasibility” of 0 (since the subsystem (|3.20[) has this status). 


All parts of Theorem]^ are useful. Part (1) allows us to generate all infeasible conic LP instances 
over cones, whose facial structure (and hence their facial reduction cone) is well understood: to do 
so, we only need to generate systems of the form ( |P>ref[ ) and reformulate them. For a more detailed 
discussion of the SDP case, we refer to Sections [^an d[6] for the case of conic LPs over smooth cones, 
which generalize p-order cones, we refer to Section!^ By Part (4) we can systematically generate conic 
linear systems that are not strongly infeasible, though this seems less interesting. 


We will use parts (1) and (2) together to find our geometric corollaries (in Section [^, and to 
generate weakly infeasible SDPs (in Section]^. 

Part (3) strengthens the infeasibility certificate obtained by Waki and Muramatsu in [40j: our 
certificate is essentially the same as theirs, the only difference is that we state it as a conic linear 
system. 


Part (4) is related to the recent paper of Lourenco et al [53]. The authors there show that if a 
semidefinite system of the form 0 is weakly infeasible, then a sequence {a[,..., alg) G FR(5") can 
be found by taking linear combinations of the Oi and applying rotations. (In fact, one can make 
(a),...,a^) to be a regularized facial reduction sequence, defined in Definition [^) In contrast, our 
results apply to general conic LPs; we exactly characterize systems that are infeasible and systems that 
are not strongly infeasible. Putting these parts together yields our geometric corollaries (in Section 
and our algorithm to generate weakly infeasible SDPs (in Section |^. 

Example already illustrates parts ([^ and ([^. A larger example, which also depicts the frontier 
of A*K*, follows; in Example]^ we choose K = K* = 
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Figure 1: The set A* 5? is in blue, and its frontier is in green 


Example 6. Let 


Oi 


/l 0 o\ /o 0 1' 

0 0 0 ,02 = 0 1 01,03 = 

0 oj \1 0 0; 



Then we claim 


d(A*Sl) = {(a,/3,jf : j>a>0}, 

1* c3 


front(A*5t) = cl(A*5:t) \ = {(0,/3, 7 )^ ^ ^ 7 > 0 }■ 


(3.22) 


(3.23) 

(3.24) 


Indeed, the inclusion C in (3.23) follows by calculating A*y for y h 0. To see the reverse inclusion, let 
be an element of the right hand side, and 


I 

( a + e 

0 

2/13\ 

y-= 

0 

7 — a + e 


1 

^ 2/13 

0 

2 / 33 / 


where e > 0, 2/13 = 0.5(/? — 7 — e + a), and 7/33 is chosen to ensure y h 0. Then 

A*y= (a + e,/ 3,7 + 2 e)^. 


and letting e —>■ 0 completes the proof of 3 . Equation (3.24) follows by case checking. 


The set is shown in Figure in blue, and its frontier in green. Note that the blue diagonal 

segment inside the green frontier actually belongs to (For better visibility, the /3 axis goes from 

positive to negative in Figure]^) 

To see how parts (1) and (2) of Theoremcertify that elements of front(A*5)(.) are indeed in this 
set, for concreteness, consider the system 


A*y = (0,-2,!)^ 

y h 0, 


(3.25) 
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which is weakly infeasible. The operations: 1) multiply the second equation by | and 2) add | times 
the third equation to it, bring (3.25) into the form of (Dref I and show that it is infeasible. Using part 
(2) of Theorem]^ the following yi and 1/2 prove that it is not strongly infeasible: 


r 

0 


\ / ° 

0 

2/1= 0 

0 

0 

, 2/2 = 0 

1 

Vo 

0 


V-3/2 

0 


(3.26) 


since A*yi = 0, A*y 2 = (0, -2,1)^, (yi, j/ 2 ) £ FR(5;(,). 


To illustrate parts (3) and (4) of Theorem we modify Example by simply exchanging two 
constraint matrices. 

Example 7. (Example continued) The semidefinite system below is weakly infeasible. 


'1 0 0\ /Of 0\ /O 0 1' 

xilO 0 0 +a:2 l 0 0 ^ 0 1 0 

>0 0 0 / \0 0 0 / 0 0 ; 


(3.27) 


To prove it is infeasible, we use part (Is]) of Theorem 0 with (yi, 2 / 2 , 2 / 3 ) G FR(5)).), where yi,y 2 are 
given in (2.17) and 

/ 0 0 -1/2^ 
ya = 0 0 0 

\-l/2 0 0 

To prove it is not strongly infeasible, we use part (|^. We write ai, 02 , and b for the constraint matrices, 
and observe that (ai, 6 ) G FR(iS)^), and is pre-strict (we can also observe that ( 01 , 02 , 6 ) G FR(iS(^)). 

The next corollary states a ” coordinate-free” version of Theorem to address a basic question in 
the theory of conic LPs: given a (weakly) infeasible conic linear system 


HDK, 


(3.28) 


where H is an affine subspace, what is the maximal/minimal dimension of an affine subspace H' with 
H' A H (or H' C H) such that H' Cl K has the same feasibility status as (3.28)? Note that by (weak) 
infeasibility of (3.28) we mean (weak) infeasibility of a representation in either the primal 0 or the 
dual 0 form. 


For instance, if K is polyhedral, and (3.28) is infeasible, then by Farkas’ lemma we can take H' as 


an affine subspace defined by a single equality constraint. 

To further illustrate this question, let us revisit Example Here we can drop variable X 2 , or add 

/O 0 0^ 

X3 0 0 1 

\0 1 0 ; 


to the left hand side, while keeping the system (3.27) weakly infeasible. 


Note that the codimension of a set S is defined as the dimension of the underlying space minus the 
dimension of S', and it is denoted by codim S. 


Corollary 1. The following hold. 
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(1) If \3. 28 ) is infeasible, then there is H' H such that 

codim H' < Ik and H' C\ K \s infeasible. 

(2) If ji3. 28 ) is not strongly infeasible, then there is H" C H such that 

dimiJ" < Ik* — 1 and 77" n TiT is not strongly infeasible. 

(3) If \3. 28 ) is weakly infeasible, then there is H" H f- H' as in parts (1) and (2) such that 

H' C\ K and H" H K are both weakly infeasible. 


Proof For part (1) we represent (3.28) as a dual type problem © (with K in place of K*), and 
apply part ([^ of Theorem We let H' be the affine subspace defined by the first 7 + 1 constraints in 
(Href), and deduce 

codim 77^ <k-\-l<lK — I + 

as required. For part (2) we represent (3.28) as a primal type problem 0 and apply part @ of 
Theorem 1^ We let 77" = lin{ai,..., o^} + 6', where the a' and h' are given in (Pref )• Then 




* - 1 , 


and this completes the proof. 


For part (3) we choose 77' as in part (1). Since (3.28) is not strongly 
system 77' n 77 is also not strongly infeasible; thus it is weakly infeasible. 
(2) with an analogous justification. 


infeasible, and 77' D 77, the 
We construct 77" as in part 

□ 


We now prove the ’’only if” parts in Theorem]^ 


Proof of Theorem We note in advance that the upper bounds on k and £ will follow from the 
facial reduction sequences being pre-strict. 

To make the proofs concise, we prove the statements out of order, starting with (|^. To see the 
’’only if” part in part (3), assume that (P) is infeasible, and consider the conic LP 


sup{a;o : Ax — bxo <k 0}, 


(3.29) 


which has value 0. The proof is complete by letting 
dual of (3.29), given in Theorem]^ 


(yi,..., ye+i) to be a feasible solution to the exact 


To prove the ’’only if” part in ([^ we fix y such that { y | ^*y = c} = y + A/’(A*). Choosing suitable 
generators for we can rewrite © in the primal form, and apply part ([^. Thus there is 7 > 0 

and a pre-strict (a'^,..., a'^,, € FR(77*) such that 


a' e TZ{A)ny-^ (7 = 1,..., 7) 

^k+i ^ T^{A), y) = — 1. 

Since (a'j^,..., a'^,, is pre-strict, are linearly independent. Since (a'j,^]^,y) {a'f.,y), 

also a'l,... are linearly independent. The proof now can be completed verbatim as the proof 

of Theorem [3l 
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For the ’’only if” part of statement © we note that since © is not strongly infeasible, the 
alternative system (Z^ait) is infeasible. We can view (Dait) as a conic linear system over the cone 
K X {0}, i.e., 


—Ax <K 0 
{-C,x} <{ 0 } 1. 


(3.30) 


By part (|^ of Lemma[^ and FRi,({0}) = we find that for all fc > 0 


{{yi,zi),...,{yk,Zk)) G FRfe(R: x {0}) {yi,...,yk) G FRfe(R:) holds. 


Thus applying part ^ to the system (3.30) 
(yi, • ■ •, Vk+i) G FR{K) and {zi,Zk+i) G “ ' 


we deduce that there is 
^ such that 


fc > 0, and a pre-strict 


A*yi + czi = 0, Zi = 0{i = l,...,k) 

A*yk+i+cZk+i = 0 , Zk+i = — 1 , 


so our claim follows. 

Finally, to prove the ’’only if” part of (|^, we note that since 0 is not strongly infeasible, the 
system (Pait) is infeasible, hence by part ([^ it has a reformulation 


{ai,y) = = 

{b\y) = -1 

(a',y) = c'(i = .^+l,...,m) 

y >K» 0 , 


(3.31) 


where {a [,..., a^, b') G FR)^^*) for some £ > 0 and the c' are suitable reals. (In (3.31) we use b' to 
denote the left hand side of the special constraint, whose right hand side is —1.) Since in (Pait) the 
only constraint with a nonzero right hand side is {b,y) = —1, we must have b' = b + Ay for some 
y G K™. Thus (Pref I is a reformulation of 0 as required. □ 


4 Certificates of infeasibility and weak infeasibility in semidef- 
inite programming 


In this section we specialize the certificates of infeasibility and weak infeasibility of Section|^to semidef- 
inite programming. For this purpose we first introduce regularized facial reduction sequences in 5" : 
these sequences have a certain staircase like structure and we will use them in Theorem in place of 
the usual facial reduction sequences in Theorem 

Definition 4. The set of order k regularized facial reduction sequences for 5" is 


REGFRfe(5”) 



Pi +... +pi_i 

Pi 

n-pi - .. 

■ -Pi 



X 

X 

\ 

..,yk)■■y^GS,yi= ^ 

I 

0 



V 

0 

0 

) 


where Pi > 0, i = 1 ,..., fc 


where the x symbols correspond to blocks with arbitrary elements. 
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We drop the subscript k if its value is clear from the context or if it is irrelevant. We say that 
{yi,... ,yk) G REGFRfe(iS") has block sizes pi,... ,pk if the order of the identity block in pi is pi for 
all i. 


Note that if {yi ,..., yk) G REGFR(5") has block sizes pi,... ,Pfc, then it is strict, if and only if 
Pi > 0 for all i. 


Also note that the constraint matrices in several examples, e.g. in Examp les [T] and [7} 
regularized facial reduction sequences. For example, the matrices in system (3.27) form 
FR 3 ( 5 i^) with block sizes 1 , 0 , 1 , respectively. 


actually form 
a sequence in 


Clearly, 

REGFRfc(5^) C FRkiS^) 

holds when n > 2. However, Lemma [2| below shows that the set REGFRfc(iS") represents the larger 
set FRfc(5"), since any element of FRfc(5") can be rotated to reside in REGER/; (5"). The proof of 
Lemma is given in Appendix [B| 

Lemma 2. Let (j/i,... ,yk) G FR(5"). Then there is an invertible matrix t such that 

{t^yit,...,t^ykt)GREGFR{Sl). 


□ 


The main result of this section follows. 

Theorem 5. In the case of semidefinite programming, i.e., when K = K* = Sf_, the following hold: 
(1) @ is infeasible, if and only if it has a reformulation 



{a'i,y) 

= 0{i = l,...,k) 



K+i^y) 

(a'i.y) 

= -1 

= c' (z = fc + 2 ,..., m) 

(-^ref,sdp) 


y 

h 0 , 


where [a'l ,.. 

e REGFR(5!f). 




(2) |D| ) is not strongly infeasible, if and only if there is {yi,... ,ye+i) G REGFR(5") such that 

A'*y, = Oii = 

A'*ye+i = c', 

where {A',c') is the data of a suitable reformulation of |5|). 

(3) {P) is infeasible, if and only if there is (yi,..., yk+i) G REGFR(iS") such that 

A'*yi = 0 , P*yi = 0 {i = l,...,k) 

A'*yk+i = 0, b'*yk+i = -1, 

where {A',b') is the data of a suitable reformulation of ©■ 

(4) {P) is not strongly infeasible, if and only if it has a reformulation 

Ttl 

^ ^ ^ b (-fref,sdp) 

i^l 

where (a^,..., a^, b') G REGFR((S!f) for some £ > 0. 
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In all parts the facial reduction sequences can be chosen as pre-strict, and k and i at most n — 1. 


□ 


Again, all parts of Theorem should be read separately, i.e., the reformulations, and the k and £ 
integers in parts (1) through (4) may all be different. 

We emphasize three key differences between Theorem and Theorem]^ First, Theorem uses 
regularized facial reduction sequences in place of the usual facial reduction sequences. Second, when 
’’reformulating” ([P|) or © in Theorem we are allowed to choose a suitable invertible matrix t and 
replace all Oi hy^ ait and b by t^bt. This is because 5" is self-dual, and the description of the 
automorphism group of S'f after equation ( |1.7[ ). Third, in parts (2) and (3) of Theorem]^ we refer to 
a suitable reformulation of © and of while in parts (2) and (3) of Theorem]^ we simply refer to 
Q and Q. 

Also, simply applying Theorem |4| with K = K* = S'f we would get the upper bound £ 5 ^ — 1 = 
(n -I-1) — 1 = n on fc and £, while Tneoremj^has the slightly stronger bound n — 1. 

We note that part (1) in Theorem recovers Theorem 1 in m- 

What is the main advantage of Theoremj^vs. Theorem]^ In Theoremj^the ’’easy,” i.e., the ”if” 
directions can be proved relying only on elementary linear algebra. For instance, to prove the ”if” 


direction in part ( 1 ), let us assume that ?/ h 0 is feasible in (Dref.sdp and that a'^,..., a'f. have block 
sizes ri,..., r/c, respectively. Then a'^uy = 0, and y ^ 0 imply that the first ri rows and columns of y 
are zero. We then inductively prove that the first ri -|- • • • -I- rows and columns of y are zero, hence 
< y > 0, which is a contradiction. For more details, we refer to [^. We can similarly prove the 


^k+l 


”if” directions in parts (2) through (4). 

Again, for the reader’s sake we first illustrate Theorem and specialize Corollary 
Example 8. (Example continued) We revisit the weakly infeasible instance 


1 O' 
0 0 , 
^0 r 
1 0 , 


• y = 0 

• y = -1 

y h 0- 


(4.32) 


Writing ai and 02 for the constraint matrices, we see that ( 01 , 02 ) G REGFR(5^), so this example 
illustrates part (1) of Theorem]^ Next, let 


t = 


0 r 

,1 0 . 


and apply the transformation t^()t to oi and 02 to obtain the system 

^0 0 ^ 


0 1 
^0 r 
1 0 , 


• y = 0 

• y = -1 

y h 0- 


(4.33) 
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This latter system illustrates part (2) of Theorem]^ since the fact that it is not strongly infeasible is 
proved by 

/l o\ / 0 -iM 


yi = 


,0 0 , 


2/2 = 


.- 1/2 


0 


and {yi,y 2 ) G REGFR(5^). 


Example 9. (Example continued) The system (3.25) in Example illustrates part (2) in Theorem 
as follows: let us exchange the first row with the third row and the Hrst column with the third 
column in all constraint matrices in (|3.25 ) to obtain a system which is also weakly infeasible. 


Let us denote this system by 


A'*y = 
y ^ 


( 0 ,- 2 ,!)^ 

0 . 


Letting 



(1 

0 


/ 0 

0 

-3/2\ 

2/1 = 

0 

0 

0 , 2/2 = 

0 

1 



lo 

0 

0 / 

V-3/2 

0 

0 / 


(4.34) 


(4.35) 


we have A'*yi = 0, A'*y 2 = (0, —2,1)^, {yi,y 2 ) G REGFR(5)^), thus the system (4.34) and {yi,y 2 ) 
are as required in part (2) of Theorem]^ 


The reader can also check that Example illustrates parts (3) and (4) of Theorem 

Corollary 2. Consider the conic linear system 1^3. 28) and assume that the underlying cone is K = 5". 
All statements of Coro/2arj/|^ applied to this system hold with £ 5 ^ — 1 = n in place of £s^ = n + 1. 

In other words we can choose H' and H" such that codim iL' < n, and dimH" < n — 1. 


Proof The proof is identical to the proof of Gorollary except we need to invoke Theorem in 
place of Theorem □ 


Proof of the ’’only if” parts in Theorem]^ To see part 0 we consider the reformulation given 
in part ([^ of Theorem and a t invertible matrix such that 

{t^a[t ,..., t^Ofe+it) G REGFR(5!(;). 


We replace a' by wa[t for all i and obtain (L>ref,sdp|)- 


To prove k < n — 1 in part (1), we note that the bound k < n follows from part (1) of Theorem 
1^ since is^ = n + 1. li k < n, then there is nothing to prove, so suppose k = n. Since {a[,..., a'^) is 
strict, the block sizes of all the o' must be all 1 , so the lower right 2 x 2 blocks of a'^_i and a'^ look 
like 

/l 0 \ , /x x^ 


,0 0 , 


and 


1 


where the x symbols stand for arbitrary components. 


Let us choose a suitable A and set o"_i := + Aa(j, so the lower right 2x2 block of a'f_i is 

positive definite. It is then easy to check that (o'^,..., a'^_ 2 , G FR(5"), and it is pre-strict. 

Finally, using Lemma we pick a suitable invertible matrix t and apply the rotation f^{)t to this 
sequence, so the result is in REGFR(5"). This completes the proof. 
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To see (1^ we consider the sequence (yi,... ,2/f+i) S FR(5") given by part ([^ of Theoremand 
a t invertible matrix such that 


t^ye+it) G REGFR(5^). 

For z = 1,..., TO and j = 1, ...,£+ 1 we have 

,t^yjt) = {ai,yj). 

We set a' := and replace yj by t^yjt for all i and j. The upper bound on £ follows by a 

similar argument as the upper bound on k in part (1), and this completes the proof. 

The proof of ([^ is analogous to the proof of ([^; and the proof of Q to the proof of Q, hence we 
omit these. □ 


5 Geometric corollaries 


In this section we use the preceding results to address several basic questions in convex analysis. We 
begin by asking the question: 


Under what conditions is the linear image of a closed convex cone closed? 

This question is fundamental, due to its role in constraint qualifications in convex programming. Due 
to its importance, Chapter 9 in Rockafellar’s classic text m is entirely devoted to it: see e.g. Theorem 
9.1 therein. Surprisingly, the literature on the subject (beyond [37] and other textbooks) appears to 
be scant. Bauschke and Borwein |3| gave a necessary and sufficient condition for the continuous image 
of a closed convex cone to be closed. Their condition (due to its greater generality) is more involved 
than Theorem 9.1 in m- See also [T], and the references in [^. We also refer to Bertsekas and Tseng 
for a study of a more general problem, when the intersection of a nested sequence of sets is nonempty. 
See Borwein and Moors mm for proofs that the set of linear maps under which the image is not 
closed is small both in terms of measure and category. 

For convenience we restate our question in an equivalent form: 


Given A and K, when is A* K* closed? 


In we gave the very simple necessary condition 

Tl{A) n (cldir(z, K) \ dir(z, K)) = 0 

for A*K* to be closed: here z is in the relative interior of Tl{A) n K, and 

dir(z, K) = {y\ z + ey £ K for some e > 0 } 


(5.36) 


is the set of feasible directions at z in K. Note that (5.36) subsumes two seemingly unrelated classical 


sufficient conditions for the closedness of A*K*, as it trivially holds when K is polyhedral, or when 
z £ liK. It is also sufficient, when the set 

K* +F-^ 


is closed, where F is the minimal cone of 'R-{A) n K. Thus (5.36) becomes an exact characterization 
when K* + F^ is closed for all F faces of K. Such cones are called nice, and reassuringly, most cones 
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that occur in optimization (such as polyhedral, semidefinite, and p-order cones) are nice. Nice cones 
also play a role in simplifying constraint qualifications in conic LPs: see [Hill]. 

As a byproduct of the preceding results, here we obtain an exact and simple characterization of 
when A*K* is closed, when K is an arbitrary closed convex cone. 

We build on the following basic fact: 

A* K* is not closed is weakly infeasible for some c. (5.37) 

Theorem 6 . The set A*K* is not closed, if and only if there is (oi,..., a^+i) G FRfc_|_i(Ar*) with 
k> 1, and (yi, ... ,yi+i) G FR^_|_i(Ar) with £ > 1 such that 

Oi € TZ(^A^ (? = 1,..., /c + 1), 

% e M{A*)U = 

and 

f 0 if i < fc 

{a^,yi+l) - ^ ifi = fc + l. 


(5.38) 

(5.39) 


Proof Starting with the forward implication, we choose c such that © is weakly infeasible. We 
choose oi,..., a/c, Uk+i as the left hand side vectors in the first fc + 1 constraints in a reformulation of 
the form (Dref I, which proves that © is infeasible; and (yi,, ye+i) to prove that it is not strongly 
infeasible: cf. parts Q and ([^ in Theorem]^ 


For the backward implication, hx a := (oi,... ,ak+i) and y := (yi,... ,y^+i) as stated. First we 
prove that they can be assumed to be pre-strict, so suppose that, say, a is not. Then for some i < k 
we have G {K H n • • • H a^)-'-, hence 


K r\ Ui r\ ■ ■ ■ r\ aj' = at n 05*“ n • • • n n , 


so we can drop a^+i from a while keeping all required properties of a and y. Continuing like this we 
arrive at both a and y being pre-strict, and to ease notation, we still assume a G FR/c+i(K*) and 
y e FR(;+i(A:). 

Now oi,... ,afc are linearly independent (by Theorem 0 - Since (ak+i,ye+i) ^ (ak,y^+i), so are 

t2i, . . . , . 

Thus we can expand ai,..., a^, into 


A' = [ai,..., Ofc, Ofc+i, a/c+ 2 ,..., a™], a basis of Tl{A), 


and let 

c' = ( 0 , ..., 0 ,-l,(afe+l,yf+l),...,(am,y^-Hl))'^■ 

Write A' = AM, with M an m X TO invertible matrix, and let c = M~"’"c'. Then © with this c is 
weakly infeasible (since A'* = M'^A*, d = M’^c, so the reformulation with data {A',c') proves that 
© is infeasible; and (yi,... ,y^+i) proves that it is not strongly infeasible: cf. Theorem]^. □ 

It is also of interest to characterize nice cones. To review previous results on nice cones we recall 
that y G K* is said to expose the set G if G C AT C y-*-; a face G of AT is said to be exposed, if it equals 
K Hy-^ for some y G K*; and it is not exposed iff 

AT* n G^ = AT* n F-^ (5.40) 
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for some F f ace o f K that strictly contains G (note that the set of vectors that expose G C K is 
K*r\G-^, so (5.40) means that all vectors that expose G actually expose the larger face F). Note that 
if y S K*, then n y*' is a supporting hyperplane of K. The cone K is said to be facially exposed, if 
all of its faces are exposed. 


Example 10 below shows a cone which is not facially exposed. 

Example 10. Define K as the sum of 5^ and the cone comprising all nonnegative multiples of the 
matrix 



r n 

VI 0/ 


n ox 

VO 0/ 


Figure 2: Cross section of a cone which is not facially exposed 


The cross-section of this cone is shown on Figure]^ with faces G C F that satisfy (5.40). The face 
G is not exposed, while F is. 


For characterizations of nice cones, and a proof that they must be facially exposed, we refer to 
Pataki [21] ; for an example of a facially exposed, but not nice cone, see Roshchina |3S] ; and Chua and 
Tungel (Mj for a proof that the linear pre-image of a nice cone is also nice. 

Theorem 1^ also leads to a characterization of when a cone is (not) nice: 

Theorem 7. Let F be a face of K. Then K* +F-^ is not closed, if and only if there is (ai,..., Ok+i) G 
FRfc+i(iV'*) with k > 1, and (jji,... ,yi+i) € FRf_|_i(iC) with .£ > 1 such that 


and 


Gi G linF (f = 1,..., fc-I-1), 
y, G F^(j = !,...,£) 


(oi, yt+i) 


0 if z < fc 
— 1 Hi = k + 1. 


(5.42) 


Proof The result follows from Theoremj^by considering a linear operator A with 'R-{A) = lin F, M{A*) 
F^ and noting that A*K* is not closed, iff Af{A*) + K* is not closed (see Lemma 3.1 in |3j). □ 


24 









Theorems and provide a hierarchy of conditions, and it is natural to ask, how these relate to 
the simpler, but less general known conditions on closedness, and niceness. To address this question, 
we need two definitions: 

Definition 5. We say that the nonclosedness of A*K* (of K* + F-^) has a {k+ !,£+!)-proof, if there 
is (ai,... ,ak+i) and (yi ,...,as in Theorem^ (Theorem^. 

Definition 6 . The singularity degree of the system H n K, where H is an affine subspace, is the 
minimum number of facial reduction steps needed by Algorithm^^to find its minimal cone. 


For example, the singularity degree of the system (2.12) is two: the facial reduction sequence given 
in (2.17) is shortest possible. 


Theorem 8 . The following hold: 


(1) Suppose that condition (5.36) is violated, and let £ be the singularity degree ofTZ{A) HK. Then 
there is a (2,£ -t- l)-proof of the nonclosedness of A*K*. 

(2) Suppose that K has a nonexposed face, say G, and F is the smallest exposed face of K that 
contains it. Then there is a {2,2)-proof that K* -\- F-^ is not closed. 


Since the proof of this result is somewhat technical, we defer it to Appendix It is also natural 
to ask, as to what values of k and £ are actually necessary to prove nonclosedness of A*K* (or of 
K* + F-^). A recent result of Drusviyatsky et al m shows a surprising connection between the 
degree of singularity of the dual problem and the exposedness of the smallest face of A*K* that 
contains c. For an equivalent, independently obtained result for semidefinite programs, see Gortler 
and Thurston m- 

It would also be interesting to explore the connection to this result and we will do so in a followup 
paper. 

Also, in recent work, Roshchina and Tungel gave a condition to strengthen the facial exposedness 
condition of [26) : it would be interesting to see how their condition fits into our hierarchy. 


6 Generating infeasible, and weakly infeasible SDPs 


We now turn to a practical aspect of our work, generating infeasible, and weakly infeasible SDP 
instances in the dual form ©. Having a library of such instances is important, since detecting infeasi¬ 
bility is a weak point of commercial and research codes: when they report that © is infeasible, they 
also return a certificate of infeasibility, namely a feasible solution to the alternative system (Dait). If © 
is weakly infeasible, then (Dait) is also infeasible, so the returned certificate is necessarily inaccurate. 


We first state an elementary algorithm, based on part (1) of Theorem]^ to generate infeasible 
SDPs in the standard form (Dref.sdp)- 


Algorithm 2 Infeasible SDP 

1: Choose integers m, n, k,pi,... ,Pk >0 and pk+i > 0 s.t. fc -|- 1 < to, z2i=i Pi — 

2: Let (oi,..., ak+i) G REGFRfc_|_i(5") with block sizes pi,... ,Pfe+i and ci = • • • = Cfc = 0, Ck+i = 
-1. 

3: Let ak+ 2 , • • ■, Qm G 5" and 0 ^+ 2 ,. .., G K be arbitrary. 
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By part (1) of Theorem all infeasible SDPs (in the dual form ( [P]) ) are obtained by taking some 
output of Algorithm and arbitrarily reformulating it. Algorithni]^ may generate a strongly or a 
weakly infeasible SDP, and the latter outcome is likelier if m is small with respect to k + 1 (in this 
case (Pait) is tightly constrained, so it is likely to be infeasible). 

However, weak infeasibility of the output of Algorithm is not guaranteed. 

Next we turn to generating weakly infeasible SDP instances with a proof of weak infeasibility. 
In contrast to Waki’s instances in [39j, we will generate our instances by solving simple systems of 
equations. In fact, we will define a natural class of weakly infeasible SDPs, and show that a simple 
algorithm generates all instances in this class. The instances will be in a form so that one can verify 
their weak infeasibility by an elementary linear algebraic argument. 


Although our framework is different - since we generate objects in an uncountably infinite set 
- our algorithms to generate all SDP instances in a certain class fit into the framework of listing 
combinatorial objects, as cycles, paths, spanning trees and cuts: see e.g., [35l|3T]. 

We will use part (1) of Theorem]^ to find an infeasible instance, and part (2) to find a (yj) sequence 
to prove that it is not strongly infeasible, so we will solve a bilinear system of equations over the 
and yj . While this may be difficult in general, it is easy if we impose a structure: we will require that 
the (oi) sequence be regularized (cf. Definition |^, and that the {yj) have the same structure, but 
“reversed” in the sense defined below: 


Definition 7. The set of order I reversed regularized facial reduction sequences in 5" is 

n-qi- Qj qj qi + . . . + q^^i 


REVREGFR,(5)() = I(yi,..., 2/^) : % G 5", y, = 


0 

0 

X 


0 

/ 

X 


X 

X 

X 


where> 0, j = I,...,^ 

where the x symbols correspond to blocks with arbitrary elements. 


We drop the subscript £, if its value is clear from the context or if it is irrelevant. We also say that 
{yi,... ,yi) G REVREGFR^(5") has block sizes qi,... ,qi if the order of the identity block in yj is qj 
for all j. 


For instance, the yj matrices in Example]^ are in REVREGFR(iS^). 
Definition 8. An SDP instance 

A*y = c 

y h 0 

is nonoverlapping weakly infeasible, if 


(6.43) 


(1) it is in the form (Dref) as in part (1) of Theorem^ with (oi,..., a^+i) G REGFR(5”) and 
Cl = • • • = Cfc = 0, Cfc+i = — I for some k > 1. 

(2) There is {yi,... ,ye+i) G REVREGFR(5!|!;) as in part (2) of Theorem^ which proves that it is 
not strongly infeasible; 

(3) The block sizes pi of (oi,..., Ofc+i) and the block sizes qj of {yi,..., yi+i) satisfy 

fc+l £+1 

i=i j=i 
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(We could of course equivalently say that (6.431 is in the form (I?ref,sdpl as given in part (1) of 
Theorem H) 


Note that condition (6.44) means that the identity blocks in the (oi) and (yj) sequences do not 
overlap. The weakly infeasible instance in Example(when we choose a = 0) is such an instance with 
Pi = gi = 1 and P 2 = <72 = 0 . 

A larger example follows: 

Example 11. The SDP 

ai»y = 0(7 = 1 , 2 ), 

03 * 2 / = -1, (6-45) 

y h 0 

is weakly infeasible, where Oi, 02 , 03 are given below: 


Oi = 


1 

0 

0 

0 

0\ 


^5 

1 

2 

2 

0\ 


I ^ 

2 

1 

3 

-2' 

0 

0 

0 

0 

0 


1 

1 

0 

0 

0 


2 

0 

0 

05 

1 

0 

0 

0 

0 

0 

, <^2 — 

2 

0 

0 

0 

0 

) ^3 — 

1 

0 

1 

0 

0 

0 

0 

0 

0 

0 


2 

0 

0 

0 

0 


3 

05 

0 

0 

0 

\0 

0 

0 

0 

oj 


u 

0 

0 

0 

oJ 


1-2 

1 

0 

0 

0 / 


(6.46) 


(Some matrix entries are underlined, since we will return to this instance to explain our algorithm.) 


Matrices j/i, 2 / 2 ,y 3 (again with some underlined entries) below show that (6.45) is nonoverlapping 
weakly infeasible: 


2/1 = 


Note that here 


r 

0 

0 

0 

O' 


0 

0 

0 

0 

A 


0 

0 

0 

0 

3' 

0 

0 

0 

0 

0 


0 

0 

0 

0 

2 


0 

0 

0 

1 

5 

0 

0 

0 

0 

0 

, 2/2 = 

0 

0 

0 

0 

1 

, P3 = 

0 

0 

0 

4 

1 

0 

0 

0 

0 

0 


0 

0 

0 

1 

0 


0 

1 

4 

1 

2 

VO 

0 

0 

0 

V 


u 

2 

1 

0 

V 



5 

1 

2 

3/ 




k-- 

= i 

= 2, Pi = 

P2 


P3 = 

= 1, 

qi = 

= <72 = 1 , 

?3 = 

0. 





(6.47) 


It is of course easy to see directly that (|6.45|) is weakly infeasible. However, if we generate matrices 
Oi (7 = 4, 5,...) such that Oi 


1/1 = at • y 2 = 0 and add the contraints ai • y = at • ys to (6.45), then 


the resulting system is still weakly infeasible, since the first three constraints prove that it is infeasible, 
and ( 2 / 1 ) 2/2 j 2 / 3 ) prove that it is not strongly so. However, weak infeasibility of the enlarged system is 
difficult to confirm directly. (A simple dimension count shows that this way we can extend (6.45) to 
have 13 constraints.) 


To proceed with stating our algorithm, for (oi,..., Ofe+i) € REGFR(iS") with block sizespi,... ,pf;+i 
we denote the 7th block containing pi integers by Pi, i.e.. 

Pi = {l,- ■ - iPi}, P 2 = {pi + 1,... ,pi +P2},- ■ • 

For ( 1 / 1 ,..., yi+i) S REVREGFR(5") with block sizes < 71 ,..., qe+i we similarly denote the jth block 
containing qj integers by Qj, i.e., 

Qi = {n- qi + 1,.. .,n}, Q 2 = {n - qi - q 2 + 1,... ,n- qi},... 
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(6.48) 


For instance, in Example [m 

Pi = {!}, P 2 = {2}, P 3 = {3}, Qi = {5}, Q 2 = {4}, Q 3 = 0. 

For a G 5" and P,Q C {1,..., n} we denote by o(P, Q) the union of two blocks of a : the first block 
is indexed by rows corresponding to P and columns corresponding to Q; and the second is the block 
symmetric with the first. We also write a(P,:) to abbreviate a(P, {1,..., n}). 

We are now ready to state our algorithm. Algorithmhrst chooses (oi,... ,afc+i) G REGFR(5”) 
and (j/i, ..., ye+i) G REVREGFR(5”) with block sizes pi and qj which satisfy inequality (6.441 . Note 
that by Dehnitionsandwe have ai{Pi,Pi) = I for all i, and yj{Qj,Qj) = I for all j, and apart 
from these blocks, only the entries in 


ai{Pi U • • • U Pj_i,:) andyj((3i U • • • U Qj-i ,:) 
are allowed to be nonzero for all i and j. 


(6.49) 


Algorithm fixes even the entries of all and of all yj in (6.49) to some arbitrary values, except 
for the entries in 

ai(Pi_i, Qi U • • • U Qi) and yj{Qj-i, Pi U • • • U Pfc) foralH > 2, and j > 2, (6.50) 

which it leaves free. The algorithm then sets the entries in these free blocks to satisfy the equations 


a,: • yj = 


0 if (bj) (^ + 1,^ + 1), 
-1 if (z, j) = (A: + 1,£ + 1). 


(6.51) 


This way we find the first fc + 1 equations in 0 and the last part of the algorithm generates the 
remaining m — k — 1. 


Algorithm 3 Nonoverlapping weakly infeasible SDP 


Choose integers m,n,k,£,pi,... ,pk,qi, ■ ■ ■ ,qi > 0 and Pk+i, qe+i > 0 to satisfy (6.44). 
Let (oi,..., Ufe+i) G REGFRfc+i(5") with block sizes pi,. ■ ■ ,Pk+i- 
Let ( 2 / 1 ,..., yi+i) G REVREGFR(5") with block sizes gi,..., qi+i- 


Fix the entries of the and of yj as described above, and leave the entries in (6.50) free, 
for f = 2 : (fc + 1) do 
for j = 2 : (f + 1) do 

(*) Set ai{Pi-i,Qj-i) and yj{Pi-i,Qj-i) to satisfy the equation (6.51) for •yj. 
end for 
end for 


Find a/c+ 2 , ■ ■■ ,am orthogonal to yi,.ye. 

Set c= (0,...,0,-1,a/c +2 • 2 /^+ 1 ,...,Cm • 2 /^+ 1 )’^. 


Algorithm can generate the weakly infeasible instance in Example by starting with only the 
offdiagonal entries of 02 and 2/2 free, then setting these to satisfy the equation 02 • 2/2 = ~1- 

Algorithm can also generate the instance given in Example [m It starts with the underlined 
entries of the a/ in (6.46) and of the yj in (6.47) free, and successively sets the entries in the following 
submatrices (note the definition of Pi and Qj in (6.48l) 


( 1 ) a2(Pi,Qi) and 2/2 (Pi,Qi) 

(2) a2(Pi,Q2) and 2/3(-Pi, Q2) 
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(3) a3(P2,Qi) and 2 / 2 (-P 2 ,Qi) 

(4) 03(P2,Q2) andy3(P2,Q2) 

Theorem 9. Algorithm always succeeds, and every nonoverlapping weakly infeasible instance is 
among its possible outputs. 


Proof To show that the algorithm always succeeds, assume that at some point we execute Step (*). 
Since Pi_i and Qj-i are nonempty, this step successfully satisfies equation (6.51). Let us consider 


an equation which involves a^, and which has been previously satisfied by the algorithm. All such 
equations have left hand side 

Oi • yt with t < j — 1. 


Let us fix such a t. We claim that 




(6.52) 


holds. Indeed, first suppose t = j — 1. Then the only nonzero entries of yt corresponding to columns 
indexed by Qj-i appear in rows corresponding to Qi U • • • U Q* (this is easiest to see by looking at the 
displayed formula in Definition]^. But inequality (6.44) translates into Pi (iQj = 0 for all i and j, so 
equation (6.52) follows. 


Next, assume t < j — 1. Then the only nonzero entries of yt corresponding to columns indexed by 


Qj-i appear in rows corresponding to Qi U • • • U Qt-i, so (6.52) follows similarly. 


Thus all previously satisfied equations that contain at remain satisfied. 

It is trivial to prove that all nonoverlapping weakly infeasible instances are among the outputs: 
suppose that such an instance is identified by (oi,..., dm) and (yi,..., with (oi,..., Ofc+i) having 
block sizes pi, ■ ■ ■ ,Pk+i, and the ijj having block sizes qj. Suppose that Algorithmat the start sets 
all entries in (ai,..., ak+i) and (yi,..., y^+i) other than the ones in ( 6.50[ ) to the corresponding values 
in the {dt) and (y^). Then there is a possible run of the algorithm which completes the at and yj to 
be equal to the di and ijj. □ 


7 Computational experiments 


To generate a test suite of challenging infeasible and weakly infeasible SDPs (in the dual form ([^) we 
implemented Algorithms and in Matlab. We ran Algorithm with parameters 

n = 10, fc = 2, Pi = 2,P2 = 3,P3 = 2, m = lOorm = 20, (7.53) 

and we call its outputs infeasible instances (these may be strongly or weakly infeasible). All entries in 
the generated instances are integers. 

We ran Algorithm with parameters 

n = 10, fc = 2, £ = 1, Pi = 2, p2 = 3, P3 = 2, yi = 2, 92 = 1 

m = 10 or m = 20 


and we call the instances it generates weakly infeasible. (These are guaranteed to be weakly infeasible.) 
We chose the components of Oi,..., ak+i in the support of the yj as integers in [—2, 2] so the entries 
in all Qi turn out to be all integers. The entries of the yj turn out to be rationale with denominators 
in the set {1,..., 5}. 
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Hence one can verify the status of our instances in exact arithmetic. 

To generate instances, in which the structure that leads to (weak) infeasibility is less readily ap¬ 
parent, we add the optional 

Messing step: Choose t = (tij) G and v = (vij) G random invertible matrices with 

entries in [—2, 2] and let 

m 

Qi = * = 1, . . . , TO. 

i=i 

The t matrix encodes elementary row operations performed on 0 , and V encodes a rotation. 

We call the instances output by Algorithms 2 and 3 clean, and the instances we hnd after the 
Messing step messy. 

The choices: “clean/messy, infeasible/weakly infeasible, to = 10/to = 20” provide eight categories 
and we generated 100 instances in each. We set the objective function as / to ensure that the primal 
problem (P) is feasible. 

We tested four solvers: we first ran the solvers Sedumi, SDPT3 and MOSEK from the YALMIP 
environment, and the preprocessing algorithm of Permenter and Parrilo |29| interfaced with Sedumi. 
The latter is marked by “PP-I-SEDUMI” in our tables. 

As the solvers consider our dual problem to be the primal, the only correct solution status is 
’’primal infeasible.” In Tables and we report the number of solved instances out of 100 for the 
various solvers. 



Infeasible 

Weakly Infeasible 

Clean 

Messy 

Clean 

Messy 

SEDUMI 

87 

27 

0 

0 

SDPT3 

10 

5 

0 

0 

MOSEK 

63 

17 

0 

0 

PP-fSEDUMI 

100 

27 

100 

0 


Table 1: Results with n = 10 ,to = 10 



Infeasible 

Weakly Infeasible 

Clean 

Messy 

Clean 

Messy 

SEDUMI 

100 

100 

I 

0 

SDPT3 

100 

96 

0 

0 

MOSEK 

100 

100 

11 

0 

PP-fSEDUMI 

100 

100 

100 

0 


Table 2: Results with n = 10, to = 20 

When the solvers do not report ’’primal infeasible”, they mostly return an error status: for example, 
for the weakly infeasible, n = 10, to = 20 instances (both clean and messy) SDPT3 always reports an 
error status. 
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We can see that 


(1) The standalone solvers do better when m goes from 10 to 20 as for larger m the portion of 
strongly infeasible instances is likely to be higher. 

(2) The standalone solvers mostly fail on the weakly infeasible problems, though MOSEK detects 
infeasibility of some. These are “almost” strongly infeasible, i.e., the alternative system (Halt) is 
almost feasible. (Of course, in exact arithmetic (Halt) is infeasible.) 

(3) The preprocessing of [53] considerably helps Sedumi on the clean instances; it does not help, 
however, on the messy instances. 

Clearly, a preprocessing algorithm like [53] could easily scan for entire facial reduction sequences in the 
input, and it is likely that some of the instances coming from applications also contain such sequences. 

The SDP instances are available from 
WWW.unc.edu/~pataki/SDP.zip 


8 Discussion and conclusion 


Here we first mention how some of our results can be further extended. 

First, the bound £k — ^ in Theorem and the bounds in Corollary have been improved by 
Lourenco et al in |22|: they show that £k can be replaced by the length of the longest chain of faces 
which starts with K and ends with a polyhedral face of K. 


Second, we note that combining Theorem[^and part Q in Lemmaj^we can write exact duals, and 
exact certihcates of infeasibility for more involved conic linear systems. For instance, we can prove 
that the system 


Aix <Ki h, 
A 2 X <K2 ^2 


(8.55) 


(where Ki and K 2 are closed convex cones) is infeasible iff there is fc > 0 and (?/i,..., j/fc+i) G 
FRfc+i(Hi) and (zi,.. .,Zk+i) G FRfc+i(it: 2 ) such that 


A\y^ + Alz^ = 0, blyi + b^Zi = 0 (* = !,..., fc) 

Alyk+i + A^Zk+i = 0 , blyk+i + b^Zk+i = - 1 . 


We next discuss how our machinery can be used to generate all infeasible conic LP instances over 
other classes of cones. The general principle is: if the facial structure of K is known - the case for 
all the cones over which we can efficiently optimize, e.g. for 5" - then it is also easy to describe the 
corresponding facial reduction cone, and infeasible systems of the form (Hj-ef) (in Theorems I and . 
The facial structure is, in fact, trivial for a broad and useful class of cones, which we call smooth cones: 
we say that H is a smooth cone if it is pointed, full-dimensional, and all faces distinct from {0} and 
K itself are one-dimensional (i.e., extreme rays). Smooth cones include the p-order cones 


{ { xq , a:) G K X 


pn—1 


a;o >||a;||p}. 


when p ^ 1, -koo, and the geometric and dual geometric cones introduced by Glineur HU. 
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If K is smooth, then any strict facial reduction sequence for K is of length at most two. Thus, if 
K \s & direct product of smooth cones, then by part (4) of Lemmawe can describe FR/j (itT) and by 
part (1) of Theorem]^ we can easily generate all infeasible conic LP instances over K. 

Consider the special case when K is the direct product of second order cones, i.e., 

K = K* = SO(ni) X ... X SO(n,), 


where 

SO(n) = { (xq, a;) S K X | ccq >|| a; II2 }■ 

The cone SO(n) has an interesting automorphism group. If x is on the boundary of SO(n), then there 
is T G Aut(SO(n)) such that Tx = (1,1, 0,..., 0)^. If x is in the interior of SO(n), then there is 
T G Aut(SO(n)) such that Tx = (1,0,... ,0)^. We can define facial reduction sequences for the cone 
K, which are in a sense ’’regularized” (just like we defined them for 5" in Definition |^, and prove an 
analog of Theorem we plan to explore this topic in a followup paper. 

We can recover variants of Ramana’s exact dual for SDP as follows. If K is nice, then {yi, ■ ■ ■ ,yk) G 
FRfc(Ar) if and only if it has a decomposition 


yi = Ui + Vi where 

{ui,Vi) G AT* X tan(ui + • • • + Mi_i, AT*) for alD. 


(8.56) 


Here tan(u, AT*) denotes the tangent space at u G AT*, and we set vq = vi = 0. Indeed, this decompo¬ 
sition follows from [m Section 4]. [57]. In turn, the cone 5" is nice, and 


tan(u, = < w + w'^ 


hence FRf;(5") is semidefinite representable. 


w 




> 0 for some j3 G 


(8.57) 


Thus the dual (Dext) in Theorem provides a template to create exact duals of 0 over known 
simple cones: to write down such a dual, we only need to represent FRfc(Ar). Therefore it is natural to 
ask: for what choices of K is FRfe(A') representable in terms of AT*, 5", or some other simple cones? 


Appendix A A definition of certificates 


In the Introduction we gave an informal definition of certificates of certain properties of conic linear 
programs, and the results of the paper can be understood relying only on this informal definition. In 
this section we give a more rigorous definition of certihcates; a fully rigorous definition can be found 
in |6|. 

We define the set of primal instances as 


Primal = {{A,b)\A:R^^Y,beY}. (A.58) 

We assume that a map A : K”’' —>■ T is represented by a suitable matrix. 

Definition 9. Let 

C : Primal —>■ Y' 

be a function with Y' being a finite dimensional Euelidean space. We say that C provides an exact 
certificate of infeasibility of 0. if there is an algorithm, a ’’verifier”, which 
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(1) Takes as input {A,b) and C{A,b), where {A,b) G Primal; 

(2) Outputs ”yes” exactly when © with data (ri, b) is infeasible; 

(3) Takes a polynomial number of steps in the size of {A, b) and C(A, b). 

A ’’step” means either a usual arithmetic operation; or checking membership in sets of the form {K H 
L)*, and (K* n J)*, where L and J are subspaces. By ’’size” of a G Y' we mean the number of 
components of a. 

We define an exact certificate of infeasibility of © , and of other properties (say of weak infeasibility) 
of © and of © analogously. 

The alert reader may notice that for our exact certificate of infeasibility given in part (3) of Theorem 
1^ it is enough to allow a verifier to check membership in a set of the form {K H L)*; and a similar 
restriction can be made for our exact certificate of infeasibility of ©■ 


Appendix B: Proof of Lemmas and 

Proof of Lemma [T] 

Proof of ([^ It is clear that FRfc(i4r) contains all nonnegative multiples of its elements, so we only 
need to show that it is convex. To this end, we use the following Claim, whose proof is straightforward: 

Claim If C is a closed, convex cone and y,z G C*, then 

cn{y + z)-^=cny-^n z-^. 


Let {yi,...,yk),{zi,...,zk) G FRfc(R:). We will prove 

{yi + zi,... ,yk + Zk) € FRfc(iF), 

which will clearly imply §■ To start, for brevity, for z = 0,..., fc we set 


□ 


(B.59) 




K Oyi 0 

■■■Oyi, 

KOz^O 

• • • n zl, 

Kr\{yi + zi)^ n • • • 

cones equal K when z 

Vi G 


Zi G 


_ 

n K, 


(B.60) 

(B.61) 

(B.62) 


for i = 1,..., fc. For i = 1 the first two hold by definition, and (B.62) follows from the Claim. Suppose 
now that i>2 and (B.601 through (B.62) hold with z — 1 in place of z. Then 


y^ G c n 
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where the first containment is by definition, the inclusion is trivial, and the equality is by using the 
induction hypothesis. This proves (B.60) and equation (B.61) holds analogously. 

Hence 


K, 


y+z,i — ^y+z,i — l {Vi Zi') 

= n n 

= Ky^i^i n n yi n zi 

— KnK 


where the hrst equation is by definition. The second follows since by (B.60) and (B.61), and since 
Ky^z,i-i is a closed convex cone, we can use the Claim with C = Kyz^z,i-ii y = Vi, z = Zi. The third 
is by the induction hypothesis, and the last is by definition. This completes the proof of (B.62). 


Now by (B.601, (B.611 and since Kyj^^ .^_-^ is a convex cone, we deduce that 

yi + Zi £ holds for i = 1,..., fc. 


This proves (B.59), and completes the proof of (1). 


Proof of ([^ Let L = Kr\ —K, assume that K is not a subspace, i.e., K ^ L, and also assume k >2. 
Let us choose a sequence {yu} C riK*, s.t. yu 0. Then 

KHyi = L ^ (KCiyi)* = L-*- foralH, 

Kno-^ = K => {Kno-^y = K*. 

Let y 2 & \ K*. (Such a y 2 exists, since K* y L-^.) Then (y^i, ?/ 2 , 0,..., 0) € FRfc(iL), and it 

converges to (0, 1 / 2 , 0 ,... ,0) ^ FRfe(Rr). 

Conversely, if iF is a subspace, then an easy calculation shows that so is FRfc(iF), which is hence 
closed. 


Proof of ([^ Let us fix r G Aut(Rr) and let S be an arbitary set. Then we claim that 



= {T*sy 

(B.63) 

T-^S^ 

= {T*S)^ 

(B.64) 

T*{Kf^S^y 

= {Kf^{T*S)^y 

(B.65) 

hold. Statement (B.63) follows, since 

y G T-^S* 

Ty G S* 



{Ty, a;) > 0 \/x € S 



{y, T*x) >0 WxGS 



y e {T*sy, 



and (B.64) follows analogously. Statement (B.65) follows by 


T*{Kr\S^y 


{T-^{KnS^)y 

{T-^Kf^T-^S^y 

{Kf^T-^S^y 

{Kr\{T*s)^)y 
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where in the first equation we used (B.63) with T * in place of T and K n S-^ in place of S. The 
seond equation is trivial, and in the third we used T~^K — K. In the last we used (B.64). 


Now let (j/i,..., Uk) G FRfe(iir), and Si = {yi,..., y^-i} for i = 1,..., fc. Then by definition we 
have Hi G {K n S:^)* for alH. Hence for all i we have 

T*y, G T*{K n 5,^)* = {Kn {T*S,)^)*, 

where the equation follows from ( B.65| ). Thus {T*yi,... ,T*yk) G FRfc(_ftr), as required. 


Proof of Q In this proof, for brevity, we will use the notation 

Ky^i = R:ny^n---ny,^, 

{KxC)y^z^i = (RT X C) n (yi,zi)-^ n • • • n 

for alH > 0 (with the understanding that these sets equal K, C, and K xC^ respectively, when i = 0). 


We will prove the equivalence (1.9) (1.10) together with the relation 


(K X X <k-l. 


(B.66) 


Clearly, both hold for fc = 1, so let us assume fc > 2 and that we proved them with fc — 1 in place 

(B.67) 


of fc. By definition, (1.9) is equivalent to 

((yi, 2:1), ■ • ■, (yfc-i, ^fc-i)) G FRfe_i(R: x c) 

and 


{yk,Zk)G{KxC)*._,. 


(B.68) 


By the induction hypothesis (B.67) is equivalent to (yi,... ,yk-i) G FR/j_i(Rr) and (zi,... ,Zk-i) G 
FRfc_i(C). So the proof is complete, if we show 


(K X C'jy^z^k—l — ^y,k—l ^ Cz^k-l- 


(B.69) 


To prove (B.69) we see that 

(RT X C)y^z,k—l — (R^ ^ C^y^z,k — 2 C i^yk—l-i Z,k — \) 

= (7fy,fc-2 X C'z_fc_ 2 ) n (y/c_i, 

= {Kyy-2 n y^_i) X {Kzy-2 n 

— Riy,fc—1 X Cz,k—1^ 

where the hrst equation is by definition, the second comes from the induction hypothesis, and the third 
follows from yk-i G K* j,_ 2 , Zk-i G C* j,_ 2 - Thus the proof is complete. 


Proof of Lemma First let us note that T G Aut(iS") (cf. equation (1.7)) iff T{x) = for some 
invertible matrix t. 

We prove the lemma by induction. Suppose that £ > 0 is an integer, and we computed a t invertible 
matrix such that 


{f'yit,...,f’ykt) G FR(5”), 
{fyit ,..., f'yit) G REGFR(5”), 


(B.70) 

(B.71) 


35 













and the block sizes in the latter sequence are pi, ... respectively. Both of these statements hold 
with £ = 0. If £ = fc, we stop. 

Otherwise, define p := pi + ■ ■ ■ + pi and y[ := t^yit for i = 1,..., fc. Let 

K = sir\y[^r\---r\ y'/-. 

Then y'^^i € K*, and K and K* are of the form 


p n — p p n — p 



where, again, the symbol © stands for a psd submatrix, and x for a submatrix with arbitrary elements. 
Let 0 be the lower n — p hy n—p block of y'i_^.i- Since 2^0, there is a g invertible matrix such that 


T 

q zq = 



where Pi+i is the rank of z. 


Let V := Ip (B q and replace t by tv. Then by part ([3|) in Lemma [T] statement (B.70) still holds, and 
by the choice of v equation (B.711 now holds with £ + 1 in place of £. This completes the proof. □ 


Appendix C: Proof of Theorem 


Proof of (1) Let us assume that condition (5.36) is violated; we will construct ( 01 , 02 ) G FR(££*) 
and {yi,... ,ye+i) G FR(iG) that satisfy (5.38) and (5.39) (with k = 1, and £ equal to the degree of 
singularity of TZ(A) n K). 


First, we choose 


oi G ri(77.(24) n K), 

02 G 77.(A) n (cldir(oi, RT) \ dir(oi, RT)), 

and let F be the minimal cone of 72 .(gI) n K (i.e., the smallest face of K that contains oi). Then 

(R:*na^)* = {K*nF^)* = cldir(oi,R:), 

where the first equality comes from oi G riR and the second can be found e.g., in |24) . Hence 

oi,02 G TZ{A), 

( 01 , 02 ) G FR(i^*) 

hold. We next choose the yj. First we pick {yi,... ,yi) G FR(Rr) such that ?/i,..., G ^(£1*) and 

F = iGny^n---ny^^. 

Since 02 ^ linR (otherwise 02 would be in dir(oi,R')) we can then choose yi+i G F^ such that 

(oi,y^+i) = 0, 

(o2,y^+i) = -1 
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hold. Thus (tti, 02 ) and (j/i,..., yi+i) are as required, and the proof is complete. 


Proof of (2) We fix F and G as stated. Since G is not exposed, and F is the smallest exposed face 
of K that contains G, we have 

G C F, K* CiG-^ = K* nF-^ 


(see equation (5.40) and the discussion afterwards). For brevity, let us define F^ = K* n F^, G^ = 
K* n G"*~, and for a face H of K* we define F[‘^ = K Cl . Thus, since F is an exposed face, we also 
have 


^AA _ 


We will choose ( 01 , 02 ) and (yi, 2 / 2 ) such that 


( 01 , 02 ) 

G 

FR{K*), 

(C.72) 

01,02 

G 

linF, 

(C.73) 

(2/i,y2) 

G 

FR(F), 

(C.74) 

yi 

G 

F^, 

(C.75) 

( 01 , 2 / 2 ) 

= 

0, 

(C.76) 

( 02 ,^ 2 ) 

= 

-1 

(C.77) 

= 1,1 = 

= 1). 




(i.e., to satisfy (5.41) and (5.42) with fc = 1, .^ = 1). 

We first choose yi G riF^. Next, since G C F, we can choose 2/2 G {F* H G-^) \ F-^. Hence 

Kny^t =Fn (F^)-^ = F^^ = F, 


where the first equation comes from yi G riF^. We thus satisfied (C.74) and (C.75). 

Next we choose oi and 02 : we choose oi G riG, and 02 G linF t o satis fy ( C.77| ) (this can be done 
since j /2 ^ F^). Thus (C.73) and (C.76) also hold. We claim that (C.72) holds as well. To see this, 
we observe 

K* na^ = K* nG-^ = K* n F-L, 

where the first equation follows from oi G ri G, and the second from F'^ = G'^. Hence 


(K*nat)* = (K*nF-^)* D linF 902, 


so (C.721 follows, and this completes the proof. 


□ 
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